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contributions to team achievement. ^°Qy 
Background Discussion of Prior Art: n n c 

As we enter the twenty-first century increasingly more of 
the problems that must be solved by humans are complex in 
nature. Their solutions require the cooperative effort of 
group members with different but complementary skills and 
experience who must interact quickly and efficiently to 
craft a solution. Groups of humans when functioning as 
intended are commonly characterized as teams. The 
literature defines a team as follows: "A team is a small 
number of people with complementary skills who are 
committed to a common purpose, performance goals, and 
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approach for which they hold themselves mutually 
accountable. ' xl 

Although reliance by humans on group effort predates 
recorded history, high performance team effort is a rare 
occurrence- This is because as the literature states, 
"Individuality and self-preservation remain the rule, 
shared responsibility based on trusting others is the 
exception. A reluctance to take a risk and submit one's 
fate to the performance of a team, therefore, is almost 
inbred" 2 . In many cases plural teams compete for the same 
resources and goals in a competitive environment. To be 
successful in a competitive environment, a team must strive 
to operate at maximum efficiency. This requires that all 
members' actions add to team synergy. 

Given the natural reluctance to team orientation, only a 
supportive value/reward system can encourage team-oriented 
action. An old business adage comes into play, "you get 
what you inspect not what you expect". By this axiom a 
team member will be motivated to maximize his or her 



1 The Wisdom of Teams; creating the high-performance organization; Jon R. Katzenbach, Douglas K. 
Smith; Harvard Business School Press, 1993 Boston MA. 

2 The Wisdom of Teams;creating the high-performance organization; Jon R. Katzenbach, Douglas K. 
Smith; Harvard Business School Press, 1993 Boston MA. 
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performance as measured, because the value/reward system is 
based on what is measured. 

An effective team value/reward system consists of three 
parts; a) a protocol for observing team activity, b) a 
method and system for measuring team-member performance, 
and c) a method and system for reporting team-member 
actions contributing to team achievement. An example of a 
compatible protocol and measuring system is the subject of 
U.S. patent application number 09/571,874, filing date 
05/13/2000, now U.S. Patent No. 6,496,812. The scope of 
the present invention is c) a method and system for 
reporting team-member actions contributing to team 
achievement. It gathers and transmits data to a central 
processor where it is processed to produce an analysis of 
team-member contributions to team achievement. 

The complex nature and the accelerated or protracted pace 
of activity of many team competitions make it difficult for 
a single reporter to identify the critical few team-member 
actions and collaborations that are causal to winning the 
contest. For this reason it is difficult for the reporter 
to gain more than a superficial understanding of the 
causality for team achievement while observing the contest. 
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The deficiencies of existing methods for investigating and 
reporting the causes for winning team contests are as 
follows : 

a) Provide no means to report the discovery of team-member 
actions and collaborations that are causal to team 
achievement, 

b) Provide no means for teaching a methodology for observing 
and reporting team-member collaborations that are causal 
to team achievement, 

c) Provide no means for team-members to report their own 
contributions to team achievement, 

d) Provide no means to report discovery of successful team- 
member actions and collaborations to contest participants 
during the remainder of an on-going contest, 

e) Provide no means for reporters to collaborate while 
observing the contest. 

Summary : 

This invention is a method and system for real-time 
reporting of team-member contributions to team achievement 
in a contest. The method segments the contest into plural 
aspects for reporting purposes. Each reporter reports one 
or more aspects of the contest. Plural reporters can 
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report the same aspect of a contest. When there is 
redundancy of ASPECT report instances, a single report is 
selected to represent the plural reports for that 
particular aspect instance. The representative reports for 
all aspects are assembled to create a contest report. 

The invention uses a game metaphor to provide enhanced 
entertainment to the reporter. However, this method and 
system is not limited to entertainment purposes. It can 
also be used where other motivations are present for the 
reporter. Reporters view a team contest and, using a pre- 
determined team-member performance measurement methodology, 
measure the contribution to team achievement made by one or 
more team-members during that contest. These measurements 
are scored and reward values are assigned to the contest 
participants for their contribution to team achievement. 
Comparing the individual measurements to a standard, 
determines their compliance with reporting rules. A 
feedback mechanism, shown in FIG. 1, notifies reporters of 
their measurement errors as an aid to improving their 
future accuracy. Reporters' validated measurements are 
filtered, scored, aggregated into contest reports and made 
available to all participating reporters. Optionally, the 
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results are presented to the contest participants to guide 
the formulation of future competitive strategy as shown in 
FIG. 2. Measurement accuracy and scope of completeness is 
evaluated to determine the reporter's skill level. As his 
expertise in implementing the value system expands, the 
reporter progresses through a series of game skill levels. 
Reporters who discover refinements to the value/reward 
system can recommend their adoption into the team-member 
performance measurement method being employed. 



The present invention achieves the following desired 
features : 

a) means to report team-member actions and collaborations 
that are causal to a team win; incorporating a means for 
observing a contest in a manner that reveals the critical 
few team-member actions; and incorporating a means to 
value team-member actions for their contribution to a 
team win, 

b) means for teaching a methodology for observing and 
reporting judgements of team-member actions and 
collaborations. Reported measurements are compared to 
standard values and accuracy exceptions are fed back to 
the reporter with instructions for proper measurement, 
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c) means for team-members participating in the contest being 
reported, to perform the reporting task, 

d) means to report discovery of successful team-member 
actions and collaborations to contest participants during 
the remainder of an on-going contest, 

e) means for reporters to collaborate while reporting a 
contest. Reporters communicate through a standard 
Internet chat facility, sharing questions and opinions to 
enhance their reporting skills. 

These improvements are accomplished by the present 
invention, which provides the following abstract objects, 
which are shown in FIG. 3: 

1. Process flow abstraction called COMPETITIVE ENVIRONMENT 
that represents a domain with a set of rules and 
conditions that determines which team-member actions are 
contested and which are uncontested. It also determines 
the relative values of functionally different team-member 
actions, thereby influencing the activity which team- 
members employ while contesting to achieve a team goal. 

2. process flow abstraction called CONTEST that represents a 
discrete event where two or more teams strive to 
exclusively achieve a common goal within a predetermined 
amount of time. 
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Process flow abstraction called POSSESSION that 
represents a unique pursuit of a team goal within a 
CONTEST, beginning with the successful acquisition of the 
resources required to achieve that goal, and proceeding 
with the enhancement of those resources by stages until 
the team goal is achieved, the resources are lost, or the 
CONTEST duration is exceeded. 

Process flow abstraction called ASPECT that represents a 
category of valued team-member actions that contribute to 
team achievement during a CONTEST. A team-member action 
within an ASPECT is called an ASPECT instance. 
Process flow abstraction called PLAYER that represents a 
team member who participates in a CONTEST by performing 
actions and interacting with other team members in 
pursuit of a team goal. 

Process flow abstraction called REPORTER that represents 
an interested CONTEST observer engaged in identifying, 
gathering and submitting data measurements concerning 
team-member actions and collaborations that contribute to 
team achievement. 

Process flow abstraction called ERROR CORRECTION CODE 
that represents a calculated quantity derived from an 
ASPECT instance measurement submitted to the reporting 
process by a REPORTER; and used to determine conformance 
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of that REPORTER'S measurements, to a standard 
measurement value for an ASPECT instance. 
8. Process flow abstraction called SKILL LEVEL that 
represents the level of competence attained by a 
REPORTER. To attain a specific SKILL LEVEL, the REPORTER 
must achieve a prescribed standard of performance as 
determined by the ERROR CORRECTION CODE values of his 
submitted ASPECT measurements as well as completeness and 
timeliness of his reports. 

9. process flow abstraction called TEAM-MEMBER INTERACTION 
PROTOCOL (TIP) shown in FIG. 14 that governs team-member 
interaction during a CONTEST. The protocol stipulates 
low priority two-way peer-to-peer communication among all 
PLAYERs and overlays a higher priority star topology two- 
way communication which places the empowered PLAYER with 
the role as STEWARD at the center of the star. The 
Steward's communications have highest priority. 

10. process flow abstraction within the TEAM-MEMBER 
INTERACTION PROTOCOL, called STEWARD which represents a 
role taken on by a PLAYER that empowers that PLAYER to 
protect team resources and advance a POSSESSION toward 
goal achievement . 
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In addition, the present invention provides the following 
mechanisms also shown in FIG. 4: 

1. The Registration Mechanism 100 is comprised of a method 
and collection of co-operating software programs 
executing on one computer or plural computers on a 
network, that enables prospective REPORTERS to become 
authorized to use this system. 

2. The Login Mechanism 200 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
checks a REPORTER'S authorization to use this system when 
he submits his userlD and password. 

3. The Sign-up Mechanism 300 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
enables a REPORTER to choose a CONTEST and ASPECT to 
report . 

4. Capture Mechanism 400 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
receives compacted data reports submitted by REPORTERS 
and makes them persistent in a centralized database. 

5. Parser Mechanism 500 is comprised of a method and 
collection of co-operating software programs executing on 
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one computer or plural computers on a network, that 
parses each of these data report strings into ASPECT data 
elements, inserts the data elements into fields in a 
report object and stores the report object in the 
database . 

6. Filter Mechanism 600 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
selects an ASPECT instance report that is representative 
of all submissions for a given ASPECT instance. This 
filtering process eliminates the need to score all but 
one of the reports for each ASPECT instance within a 
CONTEST. 

7. Assembly Mechanism 700 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
aggregates representative ASPECT reports to form 
POSSESSION reports. 

8. Scoring Mechanism 800 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
scores all POSSESSION reports by distributing the value 
assigned to the team achievement, among the PLAYERs 
reported as contributors to the successful POSSESSION. 
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9. Publishing Mechanism 900 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
aggregates results showing team-members' contributions to 
team achievement for a CONTEST and publishes the results. 

10. QC Mechanism 1000 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
compares all ASPECT instance reports to their 
representative report to see if data element values are 
identical to those of the representative ASPECT report. 
This mechanism classifies reports with identical values 
as "expected" and non-identical values as "unexpected" . 
The identical and non-identical totals are compiled for 
each REPORTER that has signed-up to score a CONTEST. A 
high occurrence of "expected" status indicates a high 
degree of reporting conformance of his ASPECT reports to 
those from most other REPORTERS. 

11. Email Mechanism 1100 is comprised of a method and 
collection of . co-operating software programs executing on 
one computer or plural computers on a network, that 
formulates and sends an email message to each REPORTER 
who has submitted reports. The email message is used to 
teach the REPORTER by pointing out his errors and 



12 



directing him to study the ASPECT Reporting Rules that he 
has miss-applied. 

12. Chat Mechanism 1200 is comprised of a method and 
collection of co-operating software programs executing on 
one computer or plural computers on a network, that 
enables the community of REPORTERS to interact and share 
questions and opinions while observing the CONTEST. When 
a REPORTER signs up to report a CONTEST, the Sign-up 
Mechanism passes his reporterlD to the Chat Mechanism and 
the REPORTER becomes authorized to enter the Chat Room 
for that CONTEST. This enables the REPORTER to 
collaborate with other REPORTERS covering that CONTEST 

13. Observer Mechanism 1300 shown in FIG. 15 that performs 
the REPORTER role, for a team of artificially intelligent 
machines or computer PLAYERs. This mechanism consists of 
neural network software programs called Observers that 
monitor the communication patterns and data-transfers 
between PLAYERs in the context of the TIP. This mechanism, 
through its self-learning neural networks, identifies 
potentially valuable sequences of activity for scrutiny by 
the REPORTER without requiring all alternatives to be 
explored. This mechanized judging function enables a 
group of artificially intelligent machines or computers to 
self-manage their interactions while they craft a solution 
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to a group goal given only partial knowledge of how to 
achieve it. 

Those and other improvements are set forth in the following 
detailed description. For a better understanding of the 
present invention with advantages and features, refer to 
the description and to the drawings. 

Detailed Description of the Invention: 

Basic Structure of a Preferred Embodiment of the Invention 

The preferred embodiment of the present invention utilizes 
a pre-determined model for achieving a group goal that 
provides a common protocol for observing a CONTEST and a 
common value system to identify valued team-member actions. 
An exemplary model is defined in U.S. patent application 
number 09/571,874, filing date 05/13/2000, now U.S. Patent 
No. 6,496,812. However, other models for achieving a group 
goal could be employed. 

The present invention segments the CONTEST into discrete 
ASPECTS in order to reduce the complexity of the reporting 
task. The invention also permits redundancy of reports 
for each ASPECT instance. This has three beneficial 
effects, 1) redundancy tends to create a statistical 
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frequency distribution for ASPECT report measurement 
values, with the highest frequency of occurrence being 
choosen as the "expected" value as shown in FIG 5, 2) 
redundancy enables the selection of a representative report 
from the set of redundant ASPECT reports, thus reducing the 
threat to data integrity resulting from false reports 
submitted by a hostile reporter as shown in FIG. 5, 3) 
redundancy eliminates the need to score all but one report 
for each ASPECT instance. 

The present invention also incorporates a multi-user game 
metaphor to enhance its entertainment value. This game 
metaphor incorporates the re-occurring themes of teamwork 
and self -improvement . The theme of teamwork emerges as a) 
the team-work of PLAYERs is measured, and in the process 
REPORTERS learn how to identify and value teamwork b) 
PLAYERs use the reported results to improve their teamwork, 
c) REPORTERS cooperate to achieve complete ASPECT coverage 
of a CONTEST, d) REPORTERS collaborate with each other to 
learn effective reporting techniques and to participate in 
refining the ASPECT Reporting Rules. As the REPORTER'S 
expertise in implementing the value system improves, he 
advances through a series of game SKILL LEVELS. SKILL 
LEVELs are attained by achieving a high level of 
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measurement accuracy. Since accuracy is a subjective- 
interpretation of the reporting rules, the assumption is 
made that plural informed REPORTERS will tend to make 
similar subjective judgements. Another assumption is that 
REPORTERS will become more informed and skilled with 
practice. Therefore report accuracy is defined as 
conformance to the norm. The subset of Normal reports for 
an ASPECT instance have the most frequently occuring ERROR 
CORRECTION CODE value in the set of ASPECT instance reports 
under consideration (see FIG. 5) . A chat facility is 
provided for REPORTERS to collaborate in their 
interpretation and refinement of the reporting rules that 
REPORTERS must follow. The system administrator can 
incorporate these improvements into the reporting rules. 
This collaborative process could enable the team of 
REPORTERS to evolve and refine the value/reward system 
being employed. 

The present invention also has the capability of indirectly 
integrating the REPORTER into the CONTEST being reported. 
This occurs in cases where reported results are processed 
by the system and fed in real-time to the CONTEST PLAYERs 
who formulate their CONTEST strategy using this feedback. 
In this case, the invention extends the CONTEST boundary to 
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include the REPORTER as an indirect CONTEST participant as 
shown in FIG. 6. 

This embodiment of the invention consists of a collection 
of co-operating computer programs executing on one computer 
or plural computers connected by a network, as shown in 
FIG. 7. This particular implementation of the invention 
utilizes an IBM HTTP Server, SendMail Mail Server, IBM 
Websphere Web Application Server and IBM DB2 database on 
plural computers connected to the Internet. The computer 
programs that implement workflow are implemented as Java 
objects in the form of Java Servlets, Java Beans, 
Enterprise Java Beans and Java Server Pages. The Java 
program interface to the Mail Server is the Java Mail API. 
Standard Internet, television and wireless communication 
protocols are employed to implement data transmission. 
However, any general-purpose message passing mechanism, 
programming language and computer platform is sufficient to 
implement the features of the present invention. The 
output of the Data Entry Device is telecommunicated over 
the Internet through a Firewall to an Internet server. 

The Reporting System shown in FIG. 8, is comprised of Java 
Servlets, Java Beans, Java Server Pages and Enterprise Java 
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Beans residing on the Internet Application Server. Objects 
are made persistent using Container Managed Persistent 
Enterprise Java Beans on the Internet Application Server 
connected through a firewall to a Database Server. The 
system verifies that the submission came from an authorized 
REPORTER and then processes the report along with reports 
from other REPORTERS to create a composite report for the 
entire CONTEST and publishes this CONTEST report as a Java 
Server Page or an XML file. The system also collects data 
on the quality of reporting and provides feedback to each 
REPORTER regarding the quality of his reporting. The 
system merges personalized report quality information into 
an explanatory text template and creates and sends the 
resulting text message as an email message via the Internet 
Mail Server using the Java Mail API. 

This embodiment of the invention is implemented in a 
fashion that reduces system administration. Internal system 
functions such as report processing and reporter feedback 
are automated, while REPORTER input such as report 
submission, REPORTER registration, Login, Chat session and 
CONTEST sign-up are event driven processes initiated by a 
REPORTER. 
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For the purposes of teaching this invention, the following 
description of a preferred embodiment uses the general 
concepts of messages and entities, instead of object- 
oriented terminology. The Reporting System of this 
embodiment as shown in FIG. 4, consists of three sub- 
systems: a) Reporter Administration, b) Report Management, 
and c) Quality Feedback. The following mechanisms comprise 
these systems. 

Reporter Administration System 
Registration Mechanism 100 

The Registration Mechanism enables prospective REPORTERS to 
become authorized to use this system. It registers each 
distinct REPORTER and assigns a unique reporterlD to him. 
It can provide a reporterlD for an existing REPORTER when 
given a userlD and password. 
Login Mechanism 200 

Checks a REPORTER'S authorization to use this system when 
he submits his userlD and password. Interacts with the 
Registration Mechanism to ascertain a REPORTER'S SKILL 
LEVEL and uses it to determine and present an appropriate 
set of game options for the REPORTER. 
Sign-up Mechanism 300 

Enables a REPORTER to choose a CONTEST and ASPECT to 
report. The REPORTER is presented with a matrix containing 
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ASPECTS and levels of committed REPORTER Coverage for the 
CONTEST he is signing up to report. This information 
enables plural REPORTERS to cooperate in providing evenly 
distributed coverage of ASPECTS within CONTESTS. Upon 
selecting a CONTEST and ASPECT, this mechanism presents the 
REPORTER with a form to record the ASPECT instance data for 
his chosen ASPECT. 
Report Management System 
Capture Mechanism 400 

Receives compacted data reports submitted by REPORTERS, 
adds a system time stamp and makes the record persistent in 
a centralized database. It then notifies the REPORTERS 
data entry device that his report has been received. This 
process is given the highest priority in order to free the 
REPORTER'S data input device for further use. This 
mechanism includes a Java Servlet operating on a high 
priority thread. The ASPECT measurement data is 
concatenated into a stream by the browser for transmission 
to this Capture Mechanism. The efficiency of data 
transmission is aided by limiting the size of the data 
stream. The individual data parameters of the report can 
be identified by their character position in the stream. 
In addition to the measurement data elements, each report 
contains data elements to identify REPORTER, SKILL LEVEL, 
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CONTEST, Team, ASPECT, POSSESSION and Error Correction 
Code. 

Parser Mechanism 500 

Processes the report data using a Java Servlet operating on 
a lower priority thread when system resources become 
available. This mechanism parses each ASPECT report data 
stream into data elements and populates a report object. 
It then makes the parsed report persistent in the 
centralized database. The Parser Mechanism maintains a 
reference to the last data stream that was parsed. This 
serves as a marker to identify new reports that must be 
parsed. This mechanism operates by periodically parsing 
data streams in queue, then sleeping in a timed sequence. 

Filter Mechanism 600 

A filtering process is employed to filter redundant 
reports. The Filter Mechanism retrieves the set of all 
parsed reports for a given ASPECT instance of a POSSESSION 
within a CONTEST. It applies an algorithm to each member 
of the set to determine if an aging requirement has been 
met. If the aging requirement has not been met, that 
member, and all other members of the set, are marked "hold" 
and no processing takes place on members of the set. The 
Filter Mechanism applies the age testing process to another 
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set of parsed reports in the database that has not been 
marked "hold". If the aging requirement has been met, the 
Filter Mechanism selects a representative report from the 
set. One selection method is to calculate the most 
frequent ERROR CORRECTION CODE value from each set of 
parsed reports. The ERROR CORRECTION CODE identifies all 
reports relating to a specific POSSESSION that contain 
identical measurement values. The ERROR CORRECTION CODE i 
the sum of all data measurements in the data measurement 
string. Reports are grouped by frequency of ERROR 
CORRECTION CODE value for each ASPECT instance within a 
CONTEST. The frequency of occurrence of the ERROR 
CORRECTION CODE value for all reports relating to each 
ASPECT instance is determined. A report with the highest 
frequency ERROR CORRECTION CODE value is selected as the 
representative report. For a hostile attack false value t 
be chosen, it must have the highest frequency of occurance 
and an associated high visability for detection. The 
chosen report is subjected to the scoring algorithm of the 
value system and used as the valid measurement for that 
ASPECT instance. The Filter Mechanism then stores this 
report in the centralized database and marks all other 
reports in the set as "filtered". 
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Assembly Mechanism 700 

Aggregates representative ASPECT reports into POSSESSION 
reports for the CONTEST. This is accomplished by loading 
the ASPECT measurement elements from the representative 
reports into the associated POSSESSION objects and making 
them persistent in the centralized database. 
Scoring Mechanism 800 

Scores all POSSESSION reports by distributing the reward 
value assigned to the team achievement resulting from that 
POSSESSION according to the scoring algorithm of the value 
system of the COMPETITIVE ENVIRONMENT. The reward value 
attributed to the successful POSSESSION is divided among 
PLAYERs that were reported as contributors to the success 
of the POSSESSION. 
Quality Feedback System 
Publishing Mechanism 900 

Aggregates POSSSESSION results into CONTEST results showing 
PLAYERs' contributions to team achievement for the CONTEST. 
These results are formatted and published for optional 
distribution via website, interactive TV, wireless device, 
electronic scoreboard, newspapers or other media of mass 
distribution . 
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QC Mechanism 1000 

Compares all ASPECT data reports to their representative 
report to see if ERROR CORRECTION CODE values are identical 
to those of the representative report. If they are, the 
reports are given "expected" status; if not identical they 
are classified with "unexpected" status. The results are 
compiled for each REPORTER as a measure of his reporting 
compliance. If the "expected" total is equal to, or 
greater than the threshold for the REPORTER SKILL LEVEL of 
that ASPECT, the REPORTER is classified as "Skilled" in 
that ASPECT. This classification is passed to the 
Registration Mechanism where it is recorded in the 
REPORTER'S record. 
Email Mechanism 1100 

Formulates an email message consisting of a template of 
explanatory text merged with personalized data obtained 
from the QC Mechanism that shows the recipient's "expected" 
and "unexpected" totals and SKILL LEVEL. This email 
message is sent to each REPORTER who has submitted reports. 
The goal is a high occurrence of "expected" status 
indicating that his results where similar to those from 
most other REPORTERS. 
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Chat Mechanism 1200 

Utilizes standard Internet Chat technology to enable the 
community of REPORTERS to interact and share experiences 
and ideas without being physically co-located. When a 
REPORTER signs up to report a CONTEST, the Sign-up 
Mechanism passes his reporterlD to the Chat Mechanism and 
the reporter becomes authorized to enter the Chat Room for 
that CONTEST. This enables the REPORTER to collaborate 
with other REPORTERS covering that CONTEST. It also 
enables messages to be sent to this group of REPORTERS by 
the system administrator. 

System Operation 

The Reporter Administration Process sequence is shown in 
FIG. 9. 
Step 1: 

A REPORTER registers himself with the Registration 
Mechanism 100. This is accomplished by using a fixed wire 
or wireless interactive Internet access device such as 
Personal computer, interactive TV set-top box, personal 
digital assistant, wireless phone, or other similar device 
to make selections and transmit data to the system data 
processing computer. The REPORTER chooses a user name and 
password and is assigned a unique reporterlD and a game 
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SKILL LEVEL=0 . The inputs to Step 1 are username and 
password. The outputs of Step 1 are reporterlD and SKILL 
LEVEL. 
Step 2: 

A REPORTER logs into the Login Mechanism 200 by submitting 
his user name and password. The Login Mechanism passes 
this information to the Registration Mechanism 100 and the 
REPORTER'S reporterlD is returned along with his SKILL 
LEVEL. The Login Mechanism uses this information to 
present the REPORTER with game options consistent with his 
SKILL LEVEL. The inputs to Step 2 are reporter user name 
and password. The output of Step 2 is a Java Server Page 
listing authorized reporting options for the REPORTER. 

Step 3: 

The REPORTER chooses a particular CONTEST from a list, and 
then chooses an ASPECT to report. A matrix showing the 
number of REPORTERS who have 'already made commitments to 
report on specific ASPECTS of his chosen CONTEST guides his 
choice. REPORTERS are motivated to choose the ASPECT with 
the lowest committed coverage in order to insure complete 
coverage of the CONTEST. By adding ASPECT instance reports 
to the pool of CONTEST information submitted by all 
REPORTERS, a REPORTER qualifies to receive analyses derived 
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from the pool of information submitted by all REPORTERS, 
This gives the REPORTER expanded insight to causality for 
the team achievement that he would not have gained as a 
single observer. Inputs to Step 3 are CONTEST, ASPECT and 
Team. Output for Step 3 is a Java Server Page data entry 
form for reporting the ASPECT specified in the input. 

Step 4: 

The REPORTER is presented with a data-entry form consistent 
with his SKILL LEVEL, and the CONTEST and ASPECT he 
selected during game sign-up. This form provides access to 
the specific ASPECT Measurement Rules that the REPORTER 
must follow in judging PLAYER actions. The form also 
provides access to the cumulative CONTEST information 
processed up to that point. The REPORTER submits the form 
with his ASPECT report measurements. This step is repeated 
for each ASPECT instance until the CONTEST ends. The input 
for Step 4 is ASPECT instance data. The output is an 
ASPECT instance report submission. 
Step 5: 

One representative ASPECT measurement is selected to 
represent each ASPECT instance of the CONTEST for a team. 
Only those representative ASPECT measurements are processed 
through the scoring algorithm. An ERROR CORRECTION CODE is 
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used as a measure to compare values of ASPECT measurements 
in the selection of the representative ASPECT report. One 
method for computing the representative ASPECT measurement 
is to group all ASPECT measurements by ERROR CORRECTION 
CODE value, for each ASPECT instance of a CONTEST. Then 
select an ASPECT report with the most frequently occurring 
ERROR CORRECTION CODE value as the representative 
measurement of this set. The Report Management Process 
has 5 steps as shown in FIG. 10: 

a) On a periodic basis, the Parser Mechanism 500 will check 
for the arrival of new ASPECT reports submitted by 
REPORTERS. It parses each of these report data strings 
into ASPECT data elements, inserts the data elements into 
fields in a report object and stores the report object in 
the database. This process is repeated until all reports 
in the arrival queue have been parsed. This process is 
repeated on a periodic basis. 

b) A filtering process is employed to reduce data processing 
and protect data integrity. On a periodic basis, the 
Filtering Mechanism 600 will select a representative 
report for each ASPECT instance for a team in an ongoing 
CONTEST . 

c) The Assembly Mechanism 700 consolidates data from these 
representative reports to populate the POSSESSION report 
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entity with ASPECT measurements and then stores the 
POSSESSION report in the database. 

d) The Scoring Mechanism 800 scores all POSSESSION reports 
by distributing the reward value assigned to the team 
achievement for that POSSESSION according to the scoring 
algorithm of the value system for the COMPETITIVE 
ENVIRONMENT. The reward value attributed to the 
successful POSSESSION is divided among P LAYERS that were 
reported as contributors to the success of the 
POSSESSION. 

e) The Publishing Mechanism 900 aggregates POSSESSION 
reports to create CONTEST reports showing PLAYERs' 
contributions to team achievement for the entire CONTEST. 
These results are formatted and published via website, 
interactive TV, wireless device, electronic scoreboard, 
newspapers or other media of mass distribution. The 
inputs to Step 5 are ASPECT instance reports. The output 
from Step 5 is a CONTEST report. 

Step 6: 

The Quality Feedback Process has 6 steps as shown below and 
in FIG. 11: 

a) On a periodic basis, with a lower processing priority, 
the QC Mechanism will check for CONTEST reports that 
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exceed an aging requirement. CONTEST reports that do 
exceed this age threshold are processed. 

b) CONTEST reports are parsed into their representative 
ASPECT instance reports. 

c) Each representative ASPECT instance report is used to 
retrieve all previously "filtered" reports for that 
ASPECT instance. 

d) Each of these "previously filtered ASPECT instance 
reports is compared with its representative ASPECT 
report using the ERROR CORRECTION CODE value to 
determine if data element values are identical to those 
of the representative report. If they are, the report 
is classified with "expected" status. If data element 
values are not identical, the ASPECT instance report is 
given "unexpected" status. The status results are a 
measure of reporting accuracy for each REPORTER that has 
signed-up to score the CONTEST, 

e) The sum of "expected" status ASPECT instance reports is 
compared to the REPORTER SKILL LEVEL threshold for that 
ASPECT; if the "expected" total is equal to or greater 
than the REPORTER SKILL LEVEL threshold for that ASPECT, 
the REPORTER is classified as "Skilled" in that ASPECT 
of reporting. 
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f ) The QC mechanism tells the Registration Mechanism to 
declare the REPORTER "skilled" in that ASPECT of 
reporting. 

The inputs to Step 6 are ASPECT instance reports and 
CONTEST reports. The outputs from Step 6 are Total 
Expected, Total Unexpected, CONTEST, ASPECT and reporterlD, 
SKILL LEVEL. 

Step 7: The Email Mechanism formulates an email message 
consisting of a template of explanatory text merged with 
personalized status results obtained from the QC Mechanism 
that shows the recipient's "expected" and "unexpected" 
report totals and his SKILL LEVEL. This email message is 
sent to each REPORTER who has submitted reports. The goal 
is a high occurrence of reports with "expected" status, 
indicating that the REPORTER'S measurements are similar to 
those of most other REPORTERS. The REPORTERS' status 
results are compared with the SKILL LEVEL threshold and his 
SKILL LEVEL is re-evaluated. REPORTERS receiving an 
excessive number of "unexpected" results are instructed to 
study the ASPECT Measurement Rules to increase the quality 
of their future judgements and achieve or maintain SKILL 
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LEVEL compliance. The Email Mechanism is also used to 
mass-communicate messages of general interest to REPORTERS. 
The inputs to Step 7 are CONTEST, Expected Results, 
Unexpected Results, reporterlD and SKILL LEVEL. The output 
of Step 7 is a personalized email message sent to each 
participating REPORTER showing his Expected Results, 
Unexpected Results and SKILL LEVEL. 

Step 8: When a REPORTER signed-up to report a CONTEST in 
Step 3, the Sign-up Mechanism passed his reporterlD to the 
Chat Mechanism and the REPORTER became authorized to enter 
the Chat Room for that CONTEST. As a result, the REPORTER 
can converse with other REPORTERS covering that CONTEST 
during and after the CONTEST. The Chat facility enables 
the REPORTERS to learn, develop group consensus and 
formulate recommendations for improvements to the reporting 
rules for the COMPETITIVE ENVIRONMENT. The system 
administrator can incorporate these improvements into the 
reporting rules. This collaborative process enables the 
team of REPORTERS to evolve and refine the value/reward 
system being employed. The inputs to Step 8 are reporterlD 
and CONTEST. The output from Step 8 is a Chat Room for the 
CONTEST specified in the input, with the reporterlD 
authorized for access to the Chat Room. 
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Description of Drawings: 
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shows Reporter Learning Process 
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2 - 


shows Player Learning Process 
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Containment Diagram showing Abstract objects 
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shows Reporting System Components 
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shows the Representative ASPECT Report 
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shows Reporting System Configuration 
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shows Reporting System Application Server 
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8 - 


shows Reporting System/ PLAYER Interaction 
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shows Reporter Administration Process Sequence 
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10 ■ 


- shows Report Management Process Sequence 
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11 - 


- shows Quality Feedback Process Sequence 
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12 ■ 


- shows Team-member managed Reward System 


Figure 


13 ■ 


- shows Self-Organized Collective Reporting 



Process 

Figure 14 - shows Team-Member Interaction Protocol (TIP) 
Figure 15 - shows Observer Mechanism 1300 
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Preferred Embodiment : 

The present disclosure illustrates the invention as applied 
to the game and business of Basketball. It is presented 
for the purpose of illustration and is not intended to 
limit the invention to the specific embodiment illustrated. 
The invention is intended to cover all implementations 
within the scope of the appended claims. 

This embodiment is a method and system comprised of a 
collection of cooperating computer programs on one or 
plural computers connected in a network. The REPORTER in 
this preferred embodiment is the dedicated fan of a 
Basketball team. The complex nature and the accelerated 
pace of activity during a Basketball game makes it 
difficult for a single fan, to identify the critical few 
PLAYER actions and collaborations that are causal to his 
team winning the game. While observing the game, it is 
difficult for fans to gain more than a superficial 
understanding of the causality for a team win. They find it 
easier to focus on PLAYERs' exceptional physical feats 
instead of creativity and collaboration among PLAYERs. 
Consequently, fans often focus on the superficial aspects 
of play. They are unable to attain their potential role, to 
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provide emotional support to their team by recognizing and 
cheering excellence in all ASPECTS of team play. 

This preferred embodiment of the present invention utilizes 
a protocol for observing the Basketball game that enables 
fans to focus on one or more of the critical few PLAYER 
actions that contribute to their team's achievement. It 
also utilizes a value system demonstrated to be consistent 
with winning, for the fan to use in identifying effective 
PLAYER actions. The protocol and value system being used 
are described in U.S. patent application number 09/571,874, 
filing date 05/13/2000, now U.S. Patent No. 6,496,812. 
This methodology breaks the CONTEST into a set of elemental 
CONTESTS called POSSESSIONS. A POSSESSION represents a 
unique pursuit of a team goal, beginning with the 
successful acquisition of the resources required to achieve 
that goal (ball) , and proceeding with the enhancement of 
those resources (create shooting opportunity) by stages 
until the team goal is achieved (shooting to score points), 
the resources are lost, or the CONTEST duration is exceeded 
(game-clock time) . 

This embodiment of the invention uses a game metaphor to 
enhance the entertainment value to the Basketball fan. The 
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game is designed to have plural fans sharing the reporting 
effort, each reporting an ASPECT of the Basketball game. 
By reporting one ASPECT, each fan REPORTER gains access to 
the pool of data reported by all REPORTERS. REPORTERS 
compete with their own personal best reporting accuracy to 
increase or maintain their SKILL LEVEL. However, they 
cooperate with fellow fan REPORTERS to insure that all 
ASPECTS of the Basketball game are reported. When fan 
REPORTERS analyze their conformance to the norm and discuss 
differences with the other REPORTERS via chat session, they 
can as a team evolve the reporting rules of the 
value/reward system being employed. This combination of 
self-competition and team-member collaboration mirrors the 
activity they are looking for in their roles as REPORTERS. 

Basketball Competitive Environment 

Winning a Basketball game requires the cooperation of five 
players. A Basketball game or CONTEST has a predetermined 
goal — to score more points than the competing team in the 
prescribed amount of time. Equal access to resources (the 
Basketball) is mandated by rules that distribute the ball 
evenly between teams but also allow teams to contest for 
possession of the ball. The game tempo and changing team 
line-ups provide a constantly changing game environment. 
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The Basketball COMPETITIVE ENVIRONMENT provides a setting 
for pure competition- In the Basketball COMPETITIVE 
ENVIRONMENT there is a winning and loosing team at the 
action level, POSSESSION level and the CONTEST level. 

In the Basketball Competitive Environment, the ultimate 
goal — winning the game — requires a team to score more 
points than the opposing team. A team can only score points 
if it has possession of the Basketball. Since a game is the 
sum of its POSSESSIONS, acquiring and maintaining 
possession of the ball are the fundamental objectives of 
each POSSESSION. During a POSSESSION the goal of one team 
is to try to maintain control of the ball and score points 
while the goal of the competing team is to try to extend 
the duration of the POSSESSION until it is successful in 
acquiring control of the ball. Each POSSESSION has a 
winning team and a losing team based on whether or not 
points are scored during that POSSESSION. The sum of the 
results of all POSSESSIONS determines the result of the 
CONTEST, or game. Basketball rules give uncontested 
possession of the ball to a team after certain events such 
as an opponent's Field Goal. 
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Operation 

Fans do not have to be present at the game to report the 
game activities- Watching on TV is sufficient to hear and 
see everything necessary to report most relevant ASPECTS of 
the game. According to the value/reward system being 
employed in this embodiment, relevant ASPECTS include 
acquiring control of the Basketball, creating a scoring 
opportunity, shooting to score points and the game-clock 
time that PLAYERs enter and leave the game. Actions are 
only valued if they result in points being scored in a 
POSSESSION. A fan must identify a potentially valued 
action and continue to follow the play to see if the action 
is part of a successful sequence resulting in points 
scored. If points are scored, the potentially valued 
action becomes a valued action and the fan submits his 
ASPECT instance report for this POSSESSION. Fans viewing 
the game on TV can submit their reports in one or more 
ways. These ways include via personal computer, 
interactive TV remote control, wireless phone or Internet 
access device. Their reports are transmitted to a 
centralized Internet server and become part of a pool of 
reports from which representative reports are selected to 
construct a composite report of all ASPECTS of the game. 
Fans only have to report on one ASPECT to gain access to 



38 



the composite information compiled from all fan reports. 
Fans are allowed to choose the ASPECT they will report. 
They are encouraged to cooperate by selecting an ASPECT 
with a relatively low level of fan coverage, thus promoting 
adequate coverage of all relevant ASPECTS of the game and 
producing a complete CONTEST report. 

By cooperating as a community in this way, fan REPORTERS 
learn and reap the benefits of teamwork themselves. Each 
fan REPORTER gains access to the pool of data gathered by 
all fans and processed by this system. This valuable 
information can also be used to benefit the game 
contestants. The game analysis produced from fan reports 
can be fed to the coaches and PLAYERS to guide competitive 
strategy as the game continues. A participant in the 
CONTEST can access the cumulative POSSESSION reports as 
they are processed and communicate the results to the 
PLAYERs. As shown in FIG. 6, the fan will play an 
important part in determining the success of his team. 
This adds to the fun and entertainment value and increases 
the motivation for fans to participate. A by-product of 
this game is the learning experience. Fans are educated in 
the factors that produce a winning team effort. When they 
choose an ASPECT to report, they are presented with the 
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ASPECT Measurement Rules for reporting PLAYER actions that 
have been demonstrated to produce winning results. By 
learning to recognize these PLAYER actions and 
collaborations, the fan learns the underlying factors that 
contribute to a winning team effort. This added insight 
creates a community of fans who find entertainment in 
collaborating via the invention's online Internet Chat 
Mechanism. 

The accuracy of the information produced by fan reporters 
is a key factor in the effectiveness of this embodiment of 
the present invention. The Quality Feedback System shown 
in FIG. 11, checks the level of compliance of a fan's 
reports and sends him an email report card after a game to 
explain how the ASPECT data in his reports compared to 
other REPORTERS' submissions covering the same ASPECT of 
that game. The email message shows the fan REPORTER how 
many of his POSSESSION reports had "expected" data values 
and how many had "unexpected" data values. It also 
contains a link to the ASPECT Measurement Rules, which he 
can study to help him achieve or maintain compliance on his 
future reports. As his expertise in implementing the value 
system expands, the fan REPORTER progresses through a 
series of game SKILL LEVELS. Fans are recognized as skilled 
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in reporting a specific ASPECT when they achieve a 
prescribed total of "expected" ASPECT reports in a game. A 
fan REPORTER that achieves this SKILL LEVEL for a single 
ASPECT is motivated to gain skill in other ASPECTS until 
proficiency is attained in all ASPECTS of reporting. An 
example of ranking levels is Gold for proficiency in four 
ASPECTS, Silver for proficiency in three ASPECTS and Bronze 
for two ASPECTS. Special privileges can be awarded based 
on these rankings. 

When a fan signs up to report a game, he can be authorized 
to enter the Chat Room for that game. This enables the fan 
REPORTER to converse with other fans reporting that 
CONTEST. The Chat facility enables fans to learn, share 
their questions and opinions, develop consensus and 
formulate group recommendations. Fans who discover 
refinements to the value/reward system can recommend their 
adoption into the team-member performance measurement 
method being employed. 

Second Preferred Embodiment 

Another preferred embodiment of this invention is a method 
and system comprised of a collection of cooperating 
computer programs executing on one or plural computers 
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connected in a network for reporting actions by Selling- 
Team members that contribute directly to a Selling-Team 
sale in a commercial COMPETITIVE ENVIRONMENT. The selling 
team is comprised of members who perform the same, or 
compatible but functionally different tasks in the sales 
process. The sales process typically consists of the 
following ASPECTS ; acquiring contact information about 
potential customers, creating a solution personalized to 
the customers' need, handling customer objections, testing 
to close and install the solution, and receiving payment. 
Unlike the Basketball COMPETITIVE ENVIRONMENT, in the 
COMMERCIAL COMPETITIVE ENVIRONMENT, competition is pure 
only at the testing, or Close and Install stage. Competing 
Selling Teams can proceed successfully through the selling 
process to the testing, or Close and Install stage. In 
this scenario a sales opportunity is a POSSESSION. Only 
POSSESSIONS that result in payment for product or service 
are considered successful. The sales compensation for a 
sale is divided among the successful Selling-Team members 
according to the model developed for the commercial 
COMPETITIVE ENVIRONMENT. 

The Selling Team can be self-managing. The protracted time 
duration of the sales process allows the reporting function 
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to be performed by the member of the Selling Team who 
performed the valued action contributing to the sale. 
Initially, only his report will be processed for each 
ASPECT instance of a CONTEST. However , any member of the 
team could submit a challenging ASPECT report. In this 
case a different filtering process is employed to select 
the representative ASPECT report. A peer review process is 
used by team-members to choose the representative report 
from contending reports. This self -managing feature 
insures that the rules of the reward system govern with no 
personal bias. This feature would enable a scenario where 
operational supervision of the sales compensation system 
resides with the Selling-Team members themselves, as shown 
in FIG. 12 , thus eliminating an obstacle to making team 
operation a self-managing function. Self -managing the 
sales compensation process also teaches the Selling-Team 
members effective team behavior. 

In this scenario, a Managing Third Party pre-determines a 
protocol for observing the selling process that enables the 
REPORTER to focus on the critical few PLAYER actions that 
contribute to a sale. A Managing Third Party would also 
set the value system for the REPORTER to use in judging the 
effectiveness of PLAYERs' actions. The protocol and value 
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system of this preferred embodiment are described in U.S. 
patent application number 09/571,874, filing date 
05/13/2000, now U.S. Patent No. 6,496,812. A Managing 
Third Party would also pre-determine the total sales 
compensation to be distributed among the Selling-Team 
PLAYERs. CONTEST results would be published for analysis by 
Selling-Team members and the Managing Third Party. 
Third Preferred Embodiment 

In another preferred embodiment of this invention that 
applies to groups of computers working on a common task, 
re-enforcement learning neural network software agents are 
included in the Observer Mechanism to fulfill the REPORTER 
function. In this case the TIP (FIG. 14) is embodied in the 
collection of software programs including the neural 
network agents, called the Observer Mechanism shown in 
FIG. 15. A neural network software agent is a component 
part of an Observer that is associated with each Player. 
The Observer's function is to monitor the flow of 
communication and data to and from that Player to identify 
potentially valuable player action sequences. It is used 
to acquire experience to decide which alternative action 
sequences to explore for valued actions. One Observer will 
communicate with the other Observers using a peer-to-peer 
network to gather communication data. The STEWARD'S 
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intelligent software agent observes the interaction between 
Players by accessing the Observer associated with each 
Player. The Observer residing on the Player computer with 
the current Steward role communicates with the other 
Observers using a star network topology that is overlaid on 
the peer-to-peer topology. This invention enables the team 
of computers to self-manage the process of integrating its 
members' activities while crafting a solution to attain a 
team goal when given only partial knowledge of how to 
achieve it. 
Conclusion : 

Exploiting the full potential of team synergy remains one 
of the most important opportunities of the twenty-first 
century. Doing so will improve team productivity and 
provide enormous economic and social benefit for mankind. 
Existing methods and systems for reporting team-member 
contributions to team achievement do not identify the 
critical few team-member actions; they do not segment the 
reporting task into ASPECTS that can be comprehended in 
real-time by a single reporter; and they don't teach a 
methodology for observing and reporting team-member 
collaboration. There is a compelling need in all areas of 
human endeavor for an effective method for valuing, 
measuring and reporting a team-member's contribution to the 
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achievement of a team goal. This invention is a method and 
system for gathering and transmitting data to a central 
processor where it is processed to produce an analysis of 
team-member contributions to team achievement. It uses a 
team-member interaction protocol for viewing the team in 
action and incorporates a value system to help the REPORTER 
focus on the critical few ASPECTS of the CONTEST. The 
measurement process is made easier by allowing each 
REPORTER to focus on one ASPECT for his REPORTS. In 
return, he benefits from receiving the consolidated CONTEST 
report derived from all relevant ASPECTS of the CONTEST. 

The use of a game metaphor adds entertainment value. It 
motivates the REPORTER to strive for judgement and 
measurement accuracy. The REPORTER receives feedback of 
his measurement compliance, enabling him to improve his 
insight and understanding of winning behavior. His 
expanding expertise is measured by a series of SKILL 
LEVELS. A connection between the REPORTER and the contest 
participants is created when the consolidated analysis is 
fed to the contest participants during an on-going CONTEST 
as input to the formulation of PLAYER strategy. The 
REPORTER indirectly becomes a participant in the CONTEST. 
This is the ultimate motivation for a REPORTER. 
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